{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"name":"NLU_multi_lingual_training_sentiment_classifier_demo_reddit.ipynb","provenance":[],"collapsed_sections":[]},"kernelspec":{"display_name":"Python 3","name":"python3"}},"cells":[{"cell_type":"markdown","metadata":{"id":"zkufh760uvF3"},"source":["![JohnSnowLabs](https://nlp.johnsnowlabs.com/assets/images/logo.png)\n","\n","[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/JohnSnowLabs/nlu/blob/master/examples//colab/Training/multi_lingual/binary_text_classification/NLU_multi_lingual_training_sentiment_classifier_demo_reddit.ipynb)\n","\n","\n","# Training a Sentiment Analysis Classifier with NLU \n","## 2 class Reddit comments sentiment classifier training\n","With the [SentimentDL model](https://nlp.johnsnowlabs.com/docs/en/annotators#sentimentdl-multi-class-sentiment-analysis-annotator)  from Spark NLP you can achieve State Of the Art results on any multi class text classification problem \n","\n","This notebook showcases the following features : \n","\n","- How to train the deep learning classifier\n","- How to store a pipeline to disk\n","- How to load the pipeline from disk (Enables NLU offline mode)\n","\n","You can achieve these results or even better on this dataset with training  data  : \n","\n","<br> \n","\n","![image.png]()\n","\n","\n","You can achieve these results or even better on this dataset with training  data  : \n","\n","<br> \n","\n","![image.png]()"]},{"cell_type":"markdown","metadata":{"id":"dur2drhW5Rvi"},"source":["# 1. Install Java 8 and NLU"]},{"cell_type":"code","metadata":{"id":"hFGnBCHavltY","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1620202060181,"user_tz":-300,"elapsed":115170,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"99ce15aa-7eec-4c6c-8dd8-d6206ed07954"},"source":["!wget https://setup.johnsnowlabs.com/nlu/colab.sh -O - | bash\n","  \n","\n","import nlu"],"execution_count":null,"outputs":[{"output_type":"stream","text":["--2021-05-05 08:05:45--  https://raw.githubusercontent.com/JohnSnowLabs/nlu/master/scripts/colab_setup.sh\n","Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.111.133, ...\n","Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 1671 (1.6K) [text/plain]\n","Saving to: ‘STDOUT’\n","\n","\r-                     0%[                    ]       0  --.-KB/s               \r-                   100%[===================>]   1.63K  --.-KB/s    in 0s      \n","\n","2021-05-05 08:05:45 (31.4 MB/s) - written to stdout [1671/1671]\n","\n","Installing  NLU 3.0.0 with  PySpark 3.0.2 and Spark NLP 3.0.1 for Google Colab ...\n","\u001b[K     |████████████████████████████████| 204.8MB 66kB/s \n","\u001b[K     |████████████████████████████████| 153kB 33.8MB/s \n","\u001b[K     |████████████████████████████████| 204kB 22.3MB/s \n","\u001b[K     |████████████████████████████████| 204kB 51.7MB/s \n","\u001b[?25h  Building wheel for pyspark (setup.py) ... \u001b[?25l\u001b[?25hdone\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"f4KkTfnR5Ugg"},"source":["# 2. Download Reddit  Sentiment dataset \n","https://www.kaggle.com/cosmos98/twitter-and-reddit-sentimental-analysis-dataset\n","#Context\n","\n","This is was a Dataset Created as a part of the university Project On Sentimental Analysis On Multi-Source Social Media Platforms using PySpark."]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"OrVb5ZMvvrQD","executionInfo":{"status":"ok","timestamp":1620202061148,"user_tz":-300,"elapsed":116120,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"52a1546e-3754-4a78-f04e-6902510b4a56"},"source":["! wget http://ckl-it.de/wp-content/uploads/2021/02/Reddit_Data_multi_lingual.csv\n"],"execution_count":null,"outputs":[{"output_type":"stream","text":["--2021-05-05 08:07:39--  http://ckl-it.de/wp-content/uploads/2021/02/Reddit_Data_multi_lingual.csv\n","Resolving ckl-it.de (ckl-it.de)... 217.160.0.108, 2001:8d8:100f:f000::209\n","Connecting to ckl-it.de (ckl-it.de)|217.160.0.108|:80... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 193200 (189K) [text/csv]\n","Saving to: ‘Reddit_Data_multi_lingual.csv’\n","\n","Reddit_Data_multi_l 100%[===================>] 188.67K   505KB/s    in 0.4s    \n","\n","2021-05-05 08:07:40 (505 KB/s) - ‘Reddit_Data_multi_lingual.csv’ saved [193200/193200]\n","\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":419},"id":"y4xSRWIhwT28","executionInfo":{"status":"ok","timestamp":1620202061743,"user_tz":-300,"elapsed":116696,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"f7ee1f9f-309e-42a5-baad-254d471d27ee"},"source":["import pandas as pd\n","train_path = '/content/Reddit_Data_multi_lingual.csv'\n","\n","train_df = pd.read_csv(train_path)\n","# the text data to use for classification should be in a column named 'text'\n","columns=['text','y']\n","train_df = train_df[columns]\n","from sklearn.model_selection import train_test_split\n","train_df, test_df = train_test_split(train_df, test_size=0.2)\n","train_df"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>text</th>\n","      <th>y</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>363</th>\n","      <td>regardless the opposition all girouds goals ha...</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>346</th>\n","      <td>lost count the amount times possible debris h...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>254</th>\n","      <td>true india needs top universities and not fdi...</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>102</th>\n","      <td>hishammuddin sounding super tired today edit s...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>212</th>\n","      <td>these two observations will help you understan...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>522</th>\n","      <td>holy shit what you for living</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>466</th>\n","      <td>jizzed hard just reading</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>378</th>\n","      <td>who will moderate the debate and which channel...</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>366</th>\n","      <td>was pro congress long time ago long time befo...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>238</th>\n","      <td>does that mean you guys are leaving india yay</td>\n","      <td>negative</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>480 rows × 2 columns</p>\n","</div>"],"text/plain":["                                                  text         y\n","363  regardless the opposition all girouds goals ha...  positive\n","346   lost count the amount times possible debris h...  negative\n","254   true india needs top universities and not fdi...  positive\n","102  hishammuddin sounding super tired today edit s...  negative\n","212  these two observations will help you understan...  negative\n","..                                                 ...       ...\n","522                     holy shit what you for living   negative\n","466                          jizzed hard just reading   negative\n","378  who will moderate the debate and which channel...  positive\n","366   was pro congress long time ago long time befo...  negative\n","238     does that mean you guys are leaving india yay   negative\n","\n","[480 rows x 2 columns]"]},"metadata":{"tags":[]},"execution_count":3}]},{"cell_type":"markdown","metadata":{"id":"0296Om2C5anY"},"source":["# 3. Train Deep Learning Classifier using nlu.load('train.sentiment')\n","\n","You dataset label column should be named 'y' and the feature column with text data should be named 'text'"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":844},"id":"IKK_Ii_gjJfF","executionInfo":{"status":"ok","timestamp":1620202564226,"user_tz":-300,"elapsed":619161,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"ab472698-fd23-4188-f48c-cf83cb702cb5"},"source":["trainable_pipe = nlu.load('xx.embed_sentence.labse train.sentiment')\n","# We need to train longer and user smaller LR for NON-USE based sentence embeddings usually\n","# We could tune the hyperparameters further with hyperparameter tuning methods like gridsearch\n","# Also longer training gives more accuracy\n","trainable_pipe['trainable_sentiment_dl'].setMaxEpochs(60)  \n","trainable_pipe['trainable_sentiment_dl'].setLr(0.005) \n","fitted_pipe = trainable_pipe.fit(train_df)\n","# predict with the trainable pipeline on dataset and get predictions\n","preds = fitted_pipe.predict(train_df,output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","from sklearn.metrics import classification_report\n","print(classification_report(preds['y'], preds['sentiment']))\n","\n","preds"],"execution_count":null,"outputs":[{"output_type":"stream","text":["labse download started this may take some time.\n","Approximate size to download 1.7 GB\n","[OK!]\n","sentence_detector_dl download started this may take some time.\n","Approximate size to download 354.6 KB\n","[OK!]\n","              precision    recall  f1-score   support\n","\n","    negative       0.97      0.98      0.98       240\n","    positive       0.98      0.97      0.97       240\n","\n","    accuracy                           0.97       480\n","   macro avg       0.98      0.97      0.97       480\n","weighted avg       0.98      0.97      0.97       480\n","\n"],"name":"stdout"},{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>text</th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>y</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>regardless the opposition all girouds goals ha...</td>\n","      <td>363</td>\n","      <td>[0.016946014016866684, -0.04248768463730812, 0...</td>\n","      <td>positive</td>\n","      <td>regardless the opposition all girouds goals ha...</td>\n","      <td>0.999915</td>\n","      <td>positive</td>\n","      <td>[regardless the opposition all girouds goals h...</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>lost count the amount times possible debris h...</td>\n","      <td>346</td>\n","      <td>[-0.0054521397687494755, 0.033800169825553894,...</td>\n","      <td>negative</td>\n","      <td>lost count the amount times possible debris ha...</td>\n","      <td>0.999966</td>\n","      <td>negative</td>\n","      <td>[lost count the amount times possible debris h...</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>true india needs top universities and not fdi...</td>\n","      <td>254</td>\n","      <td>[-0.026513056829571724, 0.022836964577436447, ...</td>\n","      <td>positive</td>\n","      <td>true india needs top universities and not fdi ...</td>\n","      <td>0.999881</td>\n","      <td>positive</td>\n","      <td>[true india needs top universities and not fdi...</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>hishammuddin sounding super tired today edit s...</td>\n","      <td>102</td>\n","      <td>[-0.024292560294270515, 0.001604165299795568, ...</td>\n","      <td>negative</td>\n","      <td>hishammuddin sounding super tired today edit s...</td>\n","      <td>0.999243</td>\n","      <td>negative</td>\n","      <td>[hishammuddin sounding super tired today edit ...</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>these two observations will help you understan...</td>\n","      <td>212</td>\n","      <td>[0.01662716642022133, 0.009799161925911903, 0....</td>\n","      <td>negative</td>\n","      <td>these two observations will help you understan...</td>\n","      <td>0.992540</td>\n","      <td>negative</td>\n","      <td>[these two observations will help you understa...</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>475</th>\n","      <td>holy shit what you for living</td>\n","      <td>522</td>\n","      <td>[0.009813179261982441, -0.07502918690443039, 0...</td>\n","      <td>negative</td>\n","      <td>holy shit what you for living</td>\n","      <td>0.999532</td>\n","      <td>negative</td>\n","      <td>[holy shit what you for living]</td>\n","    </tr>\n","    <tr>\n","      <th>476</th>\n","      <td>jizzed hard just reading</td>\n","      <td>466</td>\n","      <td>[0.021288076415657997, -0.032137248665094376, ...</td>\n","      <td>negative</td>\n","      <td>jizzed hard just reading</td>\n","      <td>0.999912</td>\n","      <td>negative</td>\n","      <td>[jizzed hard just reading]</td>\n","    </tr>\n","    <tr>\n","      <th>477</th>\n","      <td>who will moderate the debate and which channel...</td>\n","      <td>378</td>\n","      <td>[0.02036549150943756, 0.0054930429905653, -0.0...</td>\n","      <td>positive</td>\n","      <td>who will moderate the debate and which channel...</td>\n","      <td>0.998263</td>\n","      <td>positive</td>\n","      <td>[who will moderate the debate and which channe...</td>\n","    </tr>\n","    <tr>\n","      <th>478</th>\n","      <td>was pro congress long time ago long time befo...</td>\n","      <td>366</td>\n","      <td>[4.2188377847196534e-05, 0.005828899797052145,...</td>\n","      <td>negative</td>\n","      <td>was pro congress long time ago long time befor...</td>\n","      <td>0.998717</td>\n","      <td>negative</td>\n","      <td>[was pro congress long time ago long time befo...</td>\n","    </tr>\n","    <tr>\n","      <th>479</th>\n","      <td>does that mean you guys are leaving india yay</td>\n","      <td>238</td>\n","      <td>[0.004341824445873499, -0.024586506187915802, ...</td>\n","      <td>negative</td>\n","      <td>does that mean you guys are leaving india yay</td>\n","      <td>0.999851</td>\n","      <td>negative</td>\n","      <td>[does that mean you guys are leaving india yay]</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>480 rows × 8 columns</p>\n","</div>"],"text/plain":["                                                  text  ...                                           sentence\n","0    regardless the opposition all girouds goals ha...  ...  [regardless the opposition all girouds goals h...\n","1     lost count the amount times possible debris h...  ...  [lost count the amount times possible debris h...\n","2     true india needs top universities and not fdi...  ...  [true india needs top universities and not fdi...\n","3    hishammuddin sounding super tired today edit s...  ...  [hishammuddin sounding super tired today edit ...\n","4    these two observations will help you understan...  ...  [these two observations will help you understa...\n","..                                                 ...  ...                                                ...\n","475                     holy shit what you for living   ...                    [holy shit what you for living]\n","476                          jizzed hard just reading   ...                         [jizzed hard just reading]\n","477  who will moderate the debate and which channel...  ...  [who will moderate the debate and which channe...\n","478   was pro congress long time ago long time befo...  ...  [was pro congress long time ago long time befo...\n","479     does that mean you guys are leaving india yay   ...    [does that mean you guys are leaving india yay]\n","\n","[480 rows x 8 columns]"]},"metadata":{"tags":[]},"execution_count":4}]},{"cell_type":"markdown","metadata":{"id":"_1jxw3GnVGlI"},"source":["# 3.1 evaluate on Test Data"]},{"cell_type":"code","metadata":{"id":"Fxx4yNkNVGFl","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1620202588231,"user_tz":-300,"elapsed":643159,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"8c0c8d1d-add3-4c3b-cf49-3a4827e0a8f8"},"source":["preds = fitted_pipe.predict(test_df,output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","print(classification_report(preds['y'], preds['sentiment']))\n"],"execution_count":null,"outputs":[{"output_type":"stream","text":["              precision    recall  f1-score   support\n","\n","    negative       0.79      0.75      0.77        60\n","     neutral       0.00      0.00      0.00         0\n","    positive       0.79      0.77      0.78        60\n","\n","    accuracy                           0.76       120\n","   macro avg       0.53      0.51      0.52       120\n","weighted avg       0.79      0.76      0.77       120\n","\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"BD5OKO4Umc5U"},"source":["#4. Test Model  with  20 languages!"]},{"cell_type":"code","metadata":{"id":"OQ72hP9unML7","colab":{"base_uri":"https://localhost:8080/","height":759},"executionInfo":{"status":"ok","timestamp":1620202610653,"user_tz":-300,"elapsed":665574,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"3c13a8e2-a7fa-42ff-f622-583ca3ea8b9d"},"source":["train_df = pd.read_csv(\"Reddit_Data_multi_lingual.csv\")\n","preds = fitted_pipe.predict(train_df[[\"test_sentences\",\"y\"]].iloc[:100],output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","print(classification_report(preds['y'], preds['sentiment']))\n","\n","preds"],"execution_count":null,"outputs":[{"output_type":"stream","text":["              precision    recall  f1-score   support\n","\n","    negative       0.81      0.81      0.81        48\n","     neutral       0.00      0.00      0.00         0\n","    positive       0.82      0.81      0.82        52\n","\n","    accuracy                           0.81       100\n","   macro avg       0.55      0.54      0.54       100\n","weighted avg       0.82      0.81      0.81       100\n","\n"],"name":"stdout"},{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>text</th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>y</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>je pravda, že přerušili moc, jaký kongres douc...</td>\n","      <td>0</td>\n","      <td>[0.047071367502212524, -0.023074660450220108, ...</td>\n","      <td>positive</td>\n","      <td>je pravda, že přerušili moc, jaký kongres douc...</td>\n","      <td>0.999991</td>\n","      <td>positive</td>\n","      <td>[je pravda, že přerušili moc, jaký kongres dou...</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>今月のようにジルーをより良く仕上げる</td>\n","      <td>1</td>\n","      <td>[-0.01690051332116127, -0.02084467001259327, -...</td>\n","      <td>positive</td>\n","      <td>今月のようにジルーをより良く仕上げる</td>\n","      <td>0.999995</td>\n","      <td>positive</td>\n","      <td>[今月のようにジルーをより良く仕上げる]</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>נראה חרא עכשיו אבל עדיין גאה</td>\n","      <td>2</td>\n","      <td>[-0.02598223276436329, -0.02113635465502739, -...</td>\n","      <td>positive</td>\n","      <td>נראה חרא עכשיו אבל עדיין גאה</td>\n","      <td>0.978773</td>\n","      <td>positive</td>\n","      <td>[נראה חרא עכשיו אבל עדיין גאה]</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>פלור הבוער שונא את האל הרע הטוב ביותר</td>\n","      <td>3</td>\n","      <td>[-0.044415801763534546, -0.01080454234033823, ...</td>\n","      <td>negative</td>\n","      <td>פלור הבוער שונא את האל הרע הטוב ביותר</td>\n","      <td>0.999930</td>\n","      <td>negative</td>\n","      <td>[פלור הבוער שונא את האל הרע הטוב ביותר]</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>पूछ सकते हैं कि आप इस शक्तिशाली चीज़ के साथ क्...</td>\n","      <td>4</td>\n","      <td>[0.040694039314985275, -0.02741238661110401, 0...</td>\n","      <td>positive</td>\n","      <td>पूछ सकते हैं कि आप इस शक्तिशाली चीज़ के साथ क्...</td>\n","      <td>0.980074</td>\n","      <td>positive</td>\n","      <td>[पूछ सकते हैं कि आप इस शक्तिशाली चीज़ के साथ क...</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>95</th>\n","      <td>这并不奇怪</td>\n","      <td>95</td>\n","      <td>[0.026199784129858017, -0.0617312416434288, -0...</td>\n","      <td>positive</td>\n","      <td>这并不奇怪</td>\n","      <td>0.997505</td>\n","      <td>positive</td>\n","      <td>[这并不奇怪]</td>\n","    </tr>\n","    <tr>\n","      <th>96</th>\n","      <td>এই পোস্টটি বিধি লঙ্ঘন করে সর্বশেষে আপনার ছাগল ...</td>\n","      <td>96</td>\n","      <td>[0.03437668830156326, -0.033291902393102646, -...</td>\n","      <td>negative</td>\n","      <td>এই পোস্টটি বিধি লঙ্ঘন করে সর্বশেষে আপনার ছাগল ...</td>\n","      <td>0.999943</td>\n","      <td>negative</td>\n","      <td>[এই পোস্টটি বিধি লঙ্ঘন করে সর্বশেষে আপনার ছাগল...</td>\n","    </tr>\n","    <tr>\n","      <th>97</th>\n","      <td>سنا ہے براہ راست لائن نریندر مودی ہے جو کسی بھ...</td>\n","      <td>97</td>\n","      <td>[-0.0582120455801487, 0.05610273778438568, 0.0...</td>\n","      <td>positive</td>\n","      <td>سنا ہے براہ راست لائن نریندر مودی ہے جو کسی بھ...</td>\n","      <td>0.999853</td>\n","      <td>positive</td>\n","      <td>[سنا ہے براہ راست لائن نریندر مودی ہے جو کسی ب...</td>\n","    </tr>\n","    <tr>\n","      <th>98</th>\n","      <td>allah lanet olsun bu şərhlərə hindistandan çox...</td>\n","      <td>98</td>\n","      <td>[-0.02142353542149067, 0.011710312217473984, -...</td>\n","      <td>negative</td>\n","      <td>allah lanet olsun bu şərhlərə hindistandan çox...</td>\n","      <td>0.972011</td>\n","      <td>positive</td>\n","      <td>[allah lanet olsun bu şərhlərə hindistandan ço...</td>\n","    </tr>\n","    <tr>\n","      <th>99</th>\n","      <td>อัห์มดาบาดมีโอกาสที่จะกลายเป็นเมืองรถไฟใต้ดินท...</td>\n","      <td>99</td>\n","      <td>[0.003569604828953743, 0.017301399260759354, -...</td>\n","      <td>positive</td>\n","      <td>อัห์มดาบาดมีโอกาสที่จะกลายเป็นเมืองรถไฟใต้ดินท...</td>\n","      <td>0.999819</td>\n","      <td>positive</td>\n","      <td>[อัห์มดาบาดมีโอกาสที่จะกลายเป็นเมืองรถไฟใต้ดิน...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>100 rows × 8 columns</p>\n","</div>"],"text/plain":["                                                 text  ...                                           sentence\n","0   je pravda, že přerušili moc, jaký kongres douc...  ...  [je pravda, že přerušili moc, jaký kongres dou...\n","1                                 今月のようにジルーをより良く仕上げる   ...                               [今月のようにジルーをより良く仕上げる]\n","2                       נראה חרא עכשיו אבל עדיין גאה   ...                     [נראה חרא עכשיו אבל עדיין גאה]\n","3              פלור הבוער שונא את האל הרע הטוב ביותר   ...            [פלור הבוער שונא את האל הרע הטוב ביותר]\n","4   पूछ सकते हैं कि आप इस शक्तिशाली चीज़ के साथ क्...  ...  [पूछ सकते हैं कि आप इस शक्तिशाली चीज़ के साथ क...\n","..                                                ...  ...                                                ...\n","95                                             这并不奇怪   ...                                            [这并不奇怪]\n","96  এই পোস্টটি বিধি লঙ্ঘন করে সর্বশেষে আপনার ছাগল ...  ...  [এই পোস্টটি বিধি লঙ্ঘন করে সর্বশেষে আপনার ছাগল...\n","97  سنا ہے براہ راست لائن نریندر مودی ہے جو کسی بھ...  ...  [سنا ہے براہ راست لائن نریندر مودی ہے جو کسی ب...\n","98  allah lanet olsun bu şərhlərə hindistandan çox...  ...  [allah lanet olsun bu şərhlərə hindistandan ço...\n","99  อัห์มดาบาดมีโอกาสที่จะกลายเป็นเมืองรถไฟใต้ดินท...  ...  [อัห์มดาบาดมีโอกาสที่จะกลายเป็นเมืองรถไฟใต้ดิน...\n","\n","[100 rows x 8 columns]"]},"metadata":{"tags":[]},"execution_count":6}]},{"cell_type":"markdown","metadata":{"id":"RjtuNUcvuJTT"},"source":["# The Model understands Englsih\n","![en](https://www.worldometers.info/img/flags/small/tn_nz-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"o0vu7PaWkcI7","executionInfo":{"status":"ok","timestamp":1620202612106,"user_tz":-300,"elapsed":667020,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"83b39dee-e5bf-4037-f355-c87b32d619ae"},"source":["fitted_pipe.predict(\"I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away... \")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.023606013506650925, -0.02828284353017807, ...</td>\n","      <td>I am depressed because of my recent break up a...</td>\n","      <td>0.999837</td>\n","      <td>negative</td>\n","      <td>[I am depressed because of my recent break up ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [I am depressed because of my recent break up ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":7}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"1ykjRQhCtQ4w","executionInfo":{"status":"ok","timestamp":1620202613609,"user_tz":-300,"elapsed":668514,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"b90ac718-5b5b-4334-8f8c-c06312b9f923"},"source":["fitted_pipe.predict(\"The love of my life proposed me , I feel like the happiest person alive!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.0050350213423371315, 0.022905258461833, -0...</td>\n","      <td>The love of my life proposed me , I feel like ...</td>\n","      <td>0.999997</td>\n","      <td>positive</td>\n","      <td>[The love of my life proposed me , I feel like...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [The love of my life proposed me , I feel like...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":8}]},{"cell_type":"markdown","metadata":{"id":"vohym-XbuNHn"},"source":["# The Model understands German\n","![de](https://www.worldometers.info/img/flags/small/tn_gm-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"dzaaZrI4tVWc","executionInfo":{"status":"ok","timestamp":1620202614500,"user_tz":-300,"elapsed":669398,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"3b22dcbf-bd9e-416a-db54-a8862ba2dd9d"},"source":["# German for:'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"Die Liebe meines Lebens schlug mich vor, ich fühle mich wie die glücklichste Person am Leben!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[0.006932601798325777, -0.008974265307188034, ...</td>\n","      <td>Die Liebe meines Lebens schlug mich vor, ich f...</td>\n","      <td>0.999992</td>\n","      <td>positive</td>\n","      <td>[Die Liebe meines Lebens schlug mich vor, ich ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Die Liebe meines Lebens schlug mich vor, ich ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":9}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"BbhgTSBGtTtJ","executionInfo":{"status":"ok","timestamp":1620202615621,"user_tz":-300,"elapsed":670514,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"62299b8b-83e7-4dc3-81a4-9f5007a47024"},"source":["# German for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Ich bin wegen meiner kürzlichen Trennung depressiv und verbringe meine ganze Zeit damit zu weinen. Ich möchte, dass die Schmerzen verschwinden ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.04037578031420708, -0.019928034394979477, ...</td>\n","      <td>Ich bin wegen meiner kürzlichen Trennung depre...</td>\n","      <td>0.999968</td>\n","      <td>negative</td>\n","      <td>[Ich bin wegen meiner kürzlichen Trennung depr...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Ich bin wegen meiner kürzlichen Trennung depr...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":10}]},{"cell_type":"markdown","metadata":{"id":"a1JbtmWquQwj"},"source":["# The Model understands Chinese\n","![zh](https://www.worldometers.info/img/flags/small/tn_ch-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"kYSYqtoRtc-P","executionInfo":{"status":"ok","timestamp":1620202616139,"user_tz":-300,"elapsed":671022,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"ac2f9602-4983-44f2-c91b-360938c72845"},"source":["\n","# Chinese for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"由于最近的分手，我感到沮丧，我花了所有的时间哭泣，我希望痛苦能够消失... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.04107382893562317, -0.04438788816332817, 0...</td>\n","      <td>由于最近的分手，我感到沮丧，我花了所有的时间哭泣，我希望痛苦能够消失...</td>\n","      <td>0.999859</td>\n","      <td>negative</td>\n","      <td>[由于最近的分手，我感到沮丧，我花了所有的时间哭泣，我希望痛苦能够消失., ..]</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                   sentence\n","0             0  ...  [由于最近的分手，我感到沮丧，我花了所有的时间哭泣，我希望痛苦能够消失., ..]\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":11}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"06v9SD-QtlBU","executionInfo":{"status":"ok","timestamp":1620202617533,"user_tz":-300,"elapsed":672409,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"2fc34b26-a698-4526-a3d5-183ed34d17d2"},"source":["# Chinese for : \"The love of my life proposed me , I feel like the happiest person alive!\"\n","fitted_pipe.predict(\"我一生的爱向我提出了我，我感觉自己是最幸福的人！\")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.025317609310150146, -0.04454464837908745, ...</td>\n","      <td>我一生的爱向我提出了我，我感觉自己是最幸福的人！</td>\n","      <td>0.999999</td>\n","      <td>positive</td>\n","      <td>[我一生的爱向我提出了我，我感觉自己是最幸福的人！]</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                    sentence\n","0             0  ...  [我一生的爱向我提出了我，我感觉自己是最幸福的人！]\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":12}]},{"cell_type":"markdown","metadata":{"id":"9h7CvN4uu9Pb"},"source":["# Model understands Afrikaans\n","\n","![af](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)\n","\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"VMPhbgw9twtf","executionInfo":{"status":"ok","timestamp":1620202618119,"user_tz":-300,"elapsed":672985,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"3fd472f3-82f1-4d75-ed3d-a858600ddeca"},"source":["# Afrikaans for 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"Die liefde van my lewe het my voorgestel, ek voel soos die gelukkigste persoon wat lewendig is!\")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.017393874004483223, 0.005962136201560497, ...</td>\n","      <td>Die liefde van my lewe het my voorgestel, ek v...</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[Die liefde van my lewe het my voorgestel, ek ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Die liefde van my lewe het my voorgestel, ek ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":13}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"zWgNTIdkumhX","executionInfo":{"status":"ok","timestamp":1620202619781,"user_tz":-300,"elapsed":674637,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"5ad4ba58-3460-4af1-defe-80a0dfba2782"},"source":["#  Afrikaans for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Ek is depressief as gevolg van my onlangse breuk en ek spandeer al my tyd om te huil, ek wil hê dat die pyn moet verdwyn ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.042933885008096695, -0.0334482416510582, 0...</td>\n","      <td>Ek is depressief as gevolg van my onlangse bre...</td>\n","      <td>0.999771</td>\n","      <td>negative</td>\n","      <td>[Ek is depressief as gevolg van my onlangse br...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Ek is depressief as gevolg van my onlangse br...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":14}]},{"cell_type":"markdown","metadata":{"id":"rSEPkC-Bwnpg"},"source":["# The model understands Vietnamese\n","![vi](https://www.worldometers.info/img/flags/small/tn_vm-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"wCcTS5gIu511","executionInfo":{"status":"ok","timestamp":1620202620213,"user_tz":-300,"elapsed":675061,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"71a93eee-b909-4c1e-f7d0-f1a496171bc1"},"source":["# Vietnamese for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('Tình yêu của đời tôi đề xuất tôi, tôi cảm thấy như người hạnh phúc nhất còn sống!')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.03576832264661789, -0.017268849536776543, ...</td>\n","      <td>Tình yêu của đời tôi đề xuất tôi, tôi cảm thấy...</td>\n","      <td>0.999889</td>\n","      <td>positive</td>\n","      <td>[Tình yêu của đời tôi đề xuất tôi, tôi cảm thấ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Tình yêu của đời tôi đề xuất tôi, tôi cảm thấ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":15}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"lpQmMRA59REb","executionInfo":{"status":"ok","timestamp":1620202621694,"user_tz":-300,"elapsed":676532,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"99eae0ce-ebc7-4709-efd8-c4d91cecb967"},"source":["# Vietnamese for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Tôi chán nản vì cuộc chia tay gần đây và tôi dành toàn bộ thời gian để khóc, tôi muốn nỗi đau qua đi ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.009116670116782188, -0.007585291285067797,...</td>\n","      <td>Tôi chán nản vì cuộc chia tay gần đây và tôi d...</td>\n","      <td>0.99989</td>\n","      <td>negative</td>\n","      <td>[Tôi chán nản vì cuộc chia tay gần đây và tôi ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Tôi chán nản vì cuộc chia tay gần đây và tôi ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":16}]},{"cell_type":"markdown","metadata":{"id":"IlkmAaMoxTuy"},"source":["# The model understands Japanese\n","![ja](https://www.worldometers.info/img/flags/small/tn_ja-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"1IfJu3q8wwUt","executionInfo":{"status":"ok","timestamp":1620202622270,"user_tz":-300,"elapsed":677098,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"6b526a54-20ce-42e0-fdcd-68cb2f52ef4d"},"source":["\n","# Japanese for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('私の人生の愛は私を提案しました、私は生きている最も幸せな人のように感じます！')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.011561010964214802, 0.00965394638478756, -...</td>\n","      <td>私の人生の愛は私を提案しました、私は生きている最も幸せな人のように感じます！</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[私の人生の愛は私を提案しました、私は生きている最も幸せな人のように感じます！]</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                  sentence\n","0             0  ...  [私の人生の愛は私を提案しました、私は生きている最も幸せな人のように感じます！]\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":17}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"h3k7_PFhxOve","executionInfo":{"status":"ok","timestamp":1620202622854,"user_tz":-300,"elapsed":677668,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"55eca2a6-cacf-47f0-b078-60fedb82907a"},"source":["# Japanese for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"私は最近の別れのために落ち込んでいて、私はずっと泣いて過ごしています、私は痛みを取り除きたいです... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.03512014076113701, -0.03604918718338013, 0...</td>\n","      <td>私は最近の別れのために落ち込んでいて、私はずっと泣いて過ごしています、私は痛みを取り除きたい...</td>\n","      <td>0.999896</td>\n","      <td>negative</td>\n","      <td>[私は最近の別れのために落ち込んでいて、私はずっと泣いて過ごしています、私は痛みを取り除きた...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [私は最近の別れのために落ち込んでいて、私はずっと泣いて過ごしています、私は痛みを取り除きた...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":18}]},{"cell_type":"markdown","metadata":{"id":"GITfT7FK0CGv"},"source":["# The model understands Zulu\n","![zu](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"6uelDwq4xdWv","executionInfo":{"status":"ok","timestamp":1620202624064,"user_tz":-300,"elapsed":678847,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"bcbaa257-b1de-4d12-c711-19a0b684dfc8"},"source":["# Zulu for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('Uthando lwempilo yami lungihlongosile, ngizwa sengathi umuntu ojabule kunabo bonke ephila!')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.011278740130364895, -0.005037062801420689,...</td>\n","      <td>Uthando lwempilo yami lungihlongosile, ngizwa ...</td>\n","      <td>0.999999</td>\n","      <td>positive</td>\n","      <td>[Uthando lwempilo yami lungihlongosile, ngizwa...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Uthando lwempilo yami lungihlongosile, ngizwa...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":19}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"VS5JE0tC9W-h","executionInfo":{"status":"ok","timestamp":1620202624980,"user_tz":-300,"elapsed":679742,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"8e15b20e-7cac-4b07-be83-8b2ed9e2cd1a"},"source":["#  Zulu for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Ngicindezelekile ngenxa yokuhlukana kwami kwakamuva futhi ngichitha sonke isikhathi sami ngikhala, ngifuna ubuhlungu buphele ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.013925889506936073, -0.032107651233673096,...</td>\n","      <td>Ngicindezelekile ngenxa yokuhlukana kwami kwak...</td>\n","      <td>0.999893</td>\n","      <td>negative</td>\n","      <td>[Ngicindezelekile ngenxa yokuhlukana kwami kwa...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Ngicindezelekile ngenxa yokuhlukana kwami kwa...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":20}]},{"cell_type":"markdown","metadata":{"id":"VGVvzl_30a0T"},"source":["# The  Model understands Turkish\n","![tr](https://www.worldometers.info/img/flags/small/tn_tu-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"aOSsiK6J0jWs","executionInfo":{"status":"ok","timestamp":1620202625775,"user_tz":-300,"elapsed":680528,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"c12cc91a-bf6b-42bf-ae32-a74b990482f2"},"source":["# Turkish for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('Hayatımın aşkı bana teklif etti, yaşayan en mutlu insan gibi hissediyorum! ')\n","\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[0.0015444883611053228, 0.017139634117484093, ...</td>\n","      <td>Hayatımın aşkı bana teklif etti, yaşayan en mu...</td>\n","      <td>0.999999</td>\n","      <td>positive</td>\n","      <td>[Hayatımın aşkı bana teklif etti, yaşayan en m...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Hayatımın aşkı bana teklif etti, yaşayan en m...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":21}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"RFsJ9tZs9aCX","executionInfo":{"status":"ok","timestamp":1620202626744,"user_tz":-300,"elapsed":681490,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"da2a67ab-b755-4304-865d-cc33b5700dac"},"source":["#  Turkish for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Son ayrılığımdan dolayı depresyondayım ve tüm zamanımı ağlayarak geçiriyorum, acının gitmesini istiyorum ... \")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.04846595600247383, -0.041023433208465576, ...</td>\n","      <td>Son ayrılığımdan dolayı depresyondayım ve tüm ...</td>\n","      <td>0.999948</td>\n","      <td>negative</td>\n","      <td>[Son ayrılığımdan dolayı depresyondayım ve tüm...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Son ayrılığımdan dolayı depresyondayım ve tüm...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":22}]},{"cell_type":"markdown","metadata":{"id":"803qL2gt0vlb"},"source":["#  The Model understands Hebrew\n","![he](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"XQ5VCtxw0pc0","executionInfo":{"status":"ok","timestamp":1620202627823,"user_tz":-300,"elapsed":682559,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"0a2dc574-968d-4aef-ebeb-e49fb6d0d84e"},"source":["# Hebrew for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"אני בדיכאון בגלל הפרידה האחרונה שלי ואני מבלה את כל זמני בבכי, אני רוצה שהכאב ייעלם ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.04138200357556343, -0.05670207366347313, 0...</td>\n","      <td>אני בדיכאון בגלל הפרידה האחרונה שלי ואני מבלה ...</td>\n","      <td>0.999874</td>\n","      <td>negative</td>\n","      <td>[אני בדיכאון בגלל הפרידה האחרונה שלי ואני מבלה...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [אני בדיכאון בגלל הפרידה האחרונה שלי ואני מבלה...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":23}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"9w2ZHfns05A4","executionInfo":{"status":"ok","timestamp":1620202628408,"user_tz":-300,"elapsed":683127,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"c260eef9-11ad-46e1-bd89-000a3a1613c3"},"source":["# Hebrew for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('אהבת חיי הציעה אותי, אני מרגישה כמו האדם המאושר ביותר בחיים!')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.021271945908665657, -0.02133464813232422, ...</td>\n","      <td>אהבת חיי הציעה אותי, אני מרגישה כמו האדם המאוש...</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[אהבת חיי הציעה אותי, אני מרגישה כמו האדם המאו...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [אהבת חיי הציעה אותי, אני מרגישה כמו האדם המאו...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":24}]},{"cell_type":"markdown","metadata":{"id":"SDlpd33H1HIX"},"source":["# The Model understands Telugu\n","![te](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"Kc5n1bzv1BJT","executionInfo":{"status":"ok","timestamp":1620202628966,"user_tz":-300,"elapsed":683598,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"af2c9d3e-518b-4084-ceb5-f37cb8d2ada8"},"source":["# Telugu for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('నా జీవితం యొక్క ప్రేమ నన్ను ప్రతిపాదించింది, సజీవంగా ఉన్న వ్యక్తిగా నేను భావిస్తున్నాను!' )"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.011076044291257858, -0.022865094244480133,...</td>\n","      <td>నా జీవితం యొక్క ప్రేమ నన్ను ప్రతిపాదించింది, స...</td>\n","      <td>0.999512</td>\n","      <td>positive</td>\n","      <td>[నా జీవితం యొక్క ప్రేమ నన్ను ప్రతిపాదించింది, ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [నా జీవితం యొక్క ప్రేమ నన్ను ప్రతిపాదించింది, ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":25}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"-l-u6vrz1Obe","executionInfo":{"status":"ok","timestamp":1620202630256,"user_tz":-300,"elapsed":684869,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"8c425592-091d-4f36-822c-b90fe76b847c"},"source":["\n","# Telugu for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"నా ఇటీవలి విడిపోవడం వల్ల నేను నిరాశకు గురయ్యాను మరియు నా సమయాన్ని ఏడుస్తూనే ఉన్నాను, నొప్పి పోవాలని నేను కోరుకుంటున్నాను ... \")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.025107204914093018, -0.03688901290297508, ...</td>\n","      <td>నా ఇటీవలి విడిపోవడం వల్ల నేను నిరాశకు గురయ్యాన...</td>\n","      <td>0.999736</td>\n","      <td>negative</td>\n","      <td>[నా ఇటీవలి విడిపోవడం వల్ల నేను నిరాశకు గురయ్యా...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [నా ఇటీవలి విడిపోవడం వల్ల నేను నిరాశకు గురయ్యా...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":26}]},{"cell_type":"markdown","metadata":{"id":"nziBUe8t1Zwn"},"source":["# Model understands Russian\n","![ru](https://www.worldometers.info/img/flags/small/tn_rs-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"Ckyjl3YQ1VFn","executionInfo":{"status":"ok","timestamp":1620202630819,"user_tz":-300,"elapsed":685423,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"5878f2d1-006e-42df-8fc9-39d82474d560"},"source":["#  Russian for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Я в депрессии из-за моего недавнего разрыва, и я все время плачу, я хочу, чтобы боль ушла ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.042304884642362595, -0.020287370309233665,...</td>\n","      <td>Я в депрессии из-за моего недавнего разрыва, и...</td>\n","      <td>0.999906</td>\n","      <td>negative</td>\n","      <td>[Я в депрессии из-за моего недавнего разрыва, ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Я в депрессии из-за моего недавнего разрыва, ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":27}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"GIdWkfGv1gFz","executionInfo":{"status":"ok","timestamp":1620202631985,"user_tz":-300,"elapsed":686577,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"cb9c336c-84b8-4e70-b9af-21d88622e4d5"},"source":["# Russian for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('Этот фильм был отличным!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.03249521926045418, -0.04056306555867195, -...</td>\n","      <td>Этот фильм был отличным!</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[Этот фильм был отличным!]</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                    sentence\n","0             0  ...  [Этот фильм был отличным!]\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":28}]},{"cell_type":"markdown","metadata":{"id":"8R1j9mwz2Cm4"},"source":["# Model understands Urdu\n","![ur](https://www.worldometers.info/img/flags/small/tn_pk-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"j4zwvRV11pcG","executionInfo":{"status":"ok","timestamp":1620202632557,"user_tz":-300,"elapsed":687124,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"611124b9-5779-4bab-ad6e-b089823771a3"},"source":["# Urdu for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"میں حالیہ بریک اپ کی وجہ سے افسردہ ہوں اور میں اپنا سارا وقت روتے ہوئے گزارتا ہوں ، میں چاہتا ہوں کہ درد دور ہو ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.0319853238761425, -0.042503755539655685, 0...</td>\n","      <td>میں حالیہ بریک اپ کی وجہ سے افسردہ ہوں اور میں...</td>\n","      <td>0.999827</td>\n","      <td>negative</td>\n","      <td>[میں حالیہ بریک اپ کی وجہ سے افسردہ ہوں اور می...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [میں حالیہ بریک اپ کی وجہ سے افسردہ ہوں اور می...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":29}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"SxzTuK4b2UKV","executionInfo":{"status":"ok","timestamp":1620202633073,"user_tz":-300,"elapsed":687625,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"3aeceb9c-b387-4522-ac26-d44aa0f04b62"},"source":["# Urdu for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('میری زندگی کی محبت نے مجھے پیش کیا، مجھے سب سے خوشگوار شخص زندہ لگتا ہے!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.014539830386638641, -0.022852826863527298,...</td>\n","      <td>میری زندگی کی محبت نے مجھے پیش کیا، مجھے سب سے...</td>\n","      <td>0.999996</td>\n","      <td>positive</td>\n","      <td>[میری زندگی کی محبت نے مجھے پیش کیا، مجھے سب س...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [میری زندگی کی محبت نے مجھے پیش کیا، مجھے سب س...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":30}]},{"cell_type":"markdown","metadata":{"id":"RoNg-C3k1qcX"},"source":["# Model understands Hindi\n","![hi](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"QZ9RT5Wv1r1n","executionInfo":{"status":"ok","timestamp":1620202634150,"user_tz":-300,"elapsed":688689,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"3d890e16-306f-4f17-a134-072702818df8"},"source":["# Hindi for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('मेरे जीवन के प्यार ने मुझे प्रस्तावित किया, मुझे लगता है कि सबसे खुश व्यक्ति जीवित है!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.007552082184702158, 0.003644779557362199, ...</td>\n","      <td>मेरे जीवन के प्यार ने मुझे प्रस्तावित किया, मु...</td>\n","      <td>0.999995</td>\n","      <td>positive</td>\n","      <td>[मेरे जीवन के प्यार ने मुझे प्रस्तावित किया, म...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [मेरे जीवन के प्यार ने मुझे प्रस्तावित किया, म...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":31}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"quM-IL2i12-B","executionInfo":{"status":"ok","timestamp":1620202634732,"user_tz":-300,"elapsed":689259,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"4ee626e0-d134-49bf-9def-da2eba44ec98"},"source":["# Hindi for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"मेरे हालिया ब्रेक अप के कारण मैं उदास हूं और मैं अपना सारा समय रोने में बिताता हूं, मैं चाहता हूं कि दर्द दूर हो जाए ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.033875059336423874, -0.03928769379854202, ...</td>\n","      <td>मेरे हालिया ब्रेक अप के कारण मैं उदास हूं और म...</td>\n","      <td>0.999579</td>\n","      <td>negative</td>\n","      <td>[मेरे हालिया ब्रेक अप के कारण मैं उदास हूं और ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [मेरे हालिया ब्रेक अप के कारण मैं उदास हूं और ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":32}]},{"cell_type":"markdown","metadata":{"id":"R4ByHOZn35Lc"},"source":["# The model understands Tartar\n","![tt](https://www.worldometers.info/img/flags/small/tn_rs-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"2JrzusSQ18F5","executionInfo":{"status":"ok","timestamp":1620202636130,"user_tz":-300,"elapsed":690641,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"9ca5745a-5d4d-491f-f901-f3ccae8318e4"},"source":["# Tartar for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Соңгы аерылышуым аркасында мин депрессияләнәм һәм бөтен вакытымны елыйм, авыртуның китүен телим ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.04341091588139534, -0.04436178505420685, 0...</td>\n","      <td>Соңгы аерылышуым аркасында мин депрессияләнәм ...</td>\n","      <td>0.999768</td>\n","      <td>negative</td>\n","      <td>[Соңгы аерылышуым аркасында мин депрессияләнәм...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Соңгы аерылышуым аркасында мин депрессияләнәм...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":33}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"J06Xm_Ln4AYu","executionInfo":{"status":"ok","timestamp":1620202636718,"user_tz":-300,"elapsed":691220,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"11e6167e-2cde-4984-a3ee-3b932406a391"},"source":["# Tartar for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict('Тормышымның мәхәббәте миңа тәкъдим итте, мин үземне иң бәхетле кеше кебек хис итәм!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.0025619822554290295, -0.02031664550304413,...</td>\n","      <td>Тормышымның мәхәббәте миңа тәкъдим итте, мин ү...</td>\n","      <td>0.999999</td>\n","      <td>positive</td>\n","      <td>[Тормышымның мәхәббәте миңа тәкъдим итте, мин ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Тормышымның мәхәббәте миңа тәкъдим итте, мин ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":34}]},{"cell_type":"markdown","metadata":{"id":"HKj5yWwwMplH"},"source":["# The Model understands French\n","![fr](https://www.worldometers.info/img/flags/small/tn_fr-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"CUHcJZfJMplL","executionInfo":{"status":"ok","timestamp":1620202637079,"user_tz":-300,"elapsed":691550,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"a66b71f9-296a-4b4f-d45a-56bfd3e91711"},"source":["# French for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Je suis déprimé à cause de ma récente rupture et je passe tout mon temps à pleurer, je veux que la douleur disparaisse ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.026194952428340912, -0.031189769506454468,...</td>\n","      <td>Je suis déprimé à cause de ma récente rupture ...</td>\n","      <td>0.999835</td>\n","      <td>negative</td>\n","      <td>[Je suis déprimé à cause de ma récente rupture...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Je suis déprimé à cause de ma récente rupture...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":35}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"57NY2XoTMplM","executionInfo":{"status":"ok","timestamp":1620202638450,"user_tz":-300,"elapsed":692915,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"2d8c3012-02b6-4b1d-93dd-f93983c95f3a"},"source":["# French for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"L'amour de ma vie m'a proposé, je me sens comme la personne la plus heureuse en vie!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.018955670297145844, -0.024394378066062927,...</td>\n","      <td>L'amour de ma vie m'a proposé, je me sens comm...</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[L'amour de ma vie m'a proposé, je me sens com...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [L'amour de ma vie m'a proposé, je me sens com...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":36}]},{"cell_type":"markdown","metadata":{"id":"jD2TBgT0Nq6F"},"source":["# The Model understands Thai\n","![th](https://www.worldometers.info/img/flags/small/tn_th-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"gBp11S5GNq6S","executionInfo":{"status":"ok","timestamp":1620202638827,"user_tz":-300,"elapsed":693282,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"151ef2f2-dfdc-495c-fc41-36b0af49dcf3"},"source":["# Thai for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"ความรักในชีวิตของฉันเสนอให้ฉันฉันรู้สึกเหมือนคนที่มีความสุขที่สุดที่มีชีวิตอยู่!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.031056925654411316, -0.042199380695819855,...</td>\n","      <td>ความรักในชีวิตของฉันเสนอให้ฉันฉันรู้สึกเหมือนค...</td>\n","      <td>0.999998</td>\n","      <td>positive</td>\n","      <td>[ความรักในชีวิตของฉันเสนอให้ฉันฉันรู้สึกเหมือน...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [ความรักในชีวิตของฉันเสนอให้ฉันฉันรู้สึกเหมือน...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":37}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"uvlK8HEZ92qr","executionInfo":{"status":"ok","timestamp":1620202640192,"user_tz":-300,"elapsed":694642,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"54b6a661-f4b0-42f7-8a6a-650686b7050e"},"source":["# Thai for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"ฉันรู้สึกหดหู่ใจเพราะเพิ่งเลิกกันและฉันใช้เวลาร้องไห้ตลอดเวลาฉันอยากให้ความเจ็บปวดหายไป ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.01441363524645567, -0.05407707020640373, 0...</td>\n","      <td>ฉันรู้สึกหดหู่ใจเพราะเพิ่งเลิกกันและฉันใช้เวลา...</td>\n","      <td>0.999793</td>\n","      <td>negative</td>\n","      <td>[ฉันรู้สึกหดหู่ใจเพราะเพิ่งเลิกกันและฉันใช้เวล...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [ฉันรู้สึกหดหู่ใจเพราะเพิ่งเลิกกันและฉันใช้เวล...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":38}]},{"cell_type":"markdown","metadata":{"id":"mLItI4KZOElB"},"source":["# The Model understands Khmer\n","![km](https://www.worldometers.info/img/flags/small/tn_cb-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"SWbqMgAwOElC","executionInfo":{"status":"ok","timestamp":1620202640791,"user_tz":-300,"elapsed":695235,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"cb1384e8-1ce8-4630-db91-a0e0250f4c71"},"source":["# Khmer for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"សេចក្តីស្រឡាញ់នៃជីវិតរបស់ខ្ញុំបានស្នើខ្ញុំខ្ញុំមានអារម្មណ៍ថាដូចជាមនុស្សដែលសប្បាយរីករាយបំផុតនៅរស់! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[0.002843152964487672, -0.021134117618203163, ...</td>\n","      <td>សេចក្តីស្រឡាញ់នៃជីវិតរបស់ខ្ញុំបានស្នើខ្ញុំខ្ញុ...</td>\n","      <td>0.999999</td>\n","      <td>positive</td>\n","      <td>[សេចក្តីស្រឡាញ់នៃជីវិតរបស់ខ្ញុំបានស្នើខ្ញុំខ្ញ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [សេចក្តីស្រឡាញ់នៃជីវិតរបស់ខ្ញុំបានស្នើខ្ញុំខ្ញ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":39}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"YAKYMOJD95Ep","executionInfo":{"status":"ok","timestamp":1620202641730,"user_tz":-300,"elapsed":696166,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"dbf8b746-338b-4770-8ca8-00cede0282d1"},"source":["# Khmer for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"ខ្ញុំក្រៀមក្រំណាស់ដោយសារតែការបែកបាក់ថ្មីៗនេះហើយខ្ញុំចំណាយពេលវេលាយំអស់មួយជីវិតខ្ញុំចង់អោយការឈឺចាប់បាត់ទៅវិញ ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.024856086820364, -0.05315130203962326, -0....</td>\n","      <td>ខ្ញុំក្រៀមក្រំណាស់ដោយសារតែការបែកបាក់ថ្មីៗនេះហើ...</td>\n","      <td>0.999944</td>\n","      <td>negative</td>\n","      <td>[ខ្ញុំក្រៀមក្រំណាស់ដោយសារតែការបែកបាក់ថ្មីៗនេះហ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [ខ្ញុំក្រៀមក្រំណាស់ដោយសារតែការបែកបាក់ថ្មីៗនេះហ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":40}]},{"cell_type":"markdown","metadata":{"id":"lvE-LbNiPoBT"},"source":["# The Model understands Yiddish\n","![yi](https://www.worldometers.info/img/flags/small/tn_pl-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"5h-pha_nPoBc","executionInfo":{"status":"ok","timestamp":1620202642173,"user_tz":-300,"elapsed":696601,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"e35a883e-3f0f-48d6-cbed-d4c3198ec0d1"},"source":["# Yiddish for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"די ליבע פון מיין לעבן פארגעלייגט מיר, איך פילן ווי די כאַפּיאַסט מענטש לעבעדיק!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.019913051277399063, 0.015512099489569664, ...</td>\n","      <td>די ליבע פון מיין לעבן פארגעלייגט מיר, איך פילן...</td>\n","      <td>0.999998</td>\n","      <td>positive</td>\n","      <td>[די ליבע פון מיין לעבן פארגעלייגט מיר, איך פיל...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [די ליבע פון מיין לעבן פארגעלייגט מיר, איך פיל...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":41}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"yNRa1bWt97rg","executionInfo":{"status":"ok","timestamp":1620202643046,"user_tz":-300,"elapsed":697465,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"c1be6a46-0f3c-404e-d284-daa0a244aa84"},"source":["# Yiddish for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"איך בין דערשלאָגן ווייַל פון מיין לעצטנס ברעכן זיך און איך פאַרברענגען אַלע מיין צייט וויינען, איך ווילן די ווייטיק וועט גיין אַוועק ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.02142149768769741, -0.04973936453461647, 0...</td>\n","      <td>איך בין דערשלאָגן ווייַל פון מיין לעצטנס ברעכן...</td>\n","      <td>0.999752</td>\n","      <td>negative</td>\n","      <td>[איך בין דערשלאָגן ווייַל פון מיין לעצטנס ברעכ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [איך בין דערשלאָגן ווייַל פון מיין לעצטנס ברעכ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":42}]},{"cell_type":"markdown","metadata":{"id":"XSz4WzScaAHj"},"source":["# The Model understands Kygrgyz\n","![ky](https://www.worldometers.info/img/flags/small/tn_kg-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"lh_ZSHlPaAHv","executionInfo":{"status":"ok","timestamp":1620202643577,"user_tz":-300,"elapsed":697989,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"cd32af06-598a-416b-ceaa-571a5e8eeccc"},"source":["# Kygrgyz for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"Менин жашоомдун сүйүүсү мени сунуш кылды, мен өзүмдү бактылуу адамдай сезип жатам!|\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.030747268348932266, -0.025966504588723183,...</td>\n","      <td>Менин жашоомдун сүйүүсү мени сунуш кылды, мен ...</td>\n","      <td>0.999741</td>\n","      <td>positive</td>\n","      <td>[Менин жашоомдун сүйүүсү мени сунуш кылды, мен...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Менин жашоомдун сүйүүсү мени сунуш кылды, мен...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":43}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"2kfUZ33P9-hX","executionInfo":{"status":"ok","timestamp":1620202644330,"user_tz":-300,"elapsed":698733,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"8f4bd029-27da-4e10-a797-f404ac30c448"},"source":["\n","# Kygrgyz for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"Менин акыркы ажырашуумдан улам депрессияга кабылып, бардык убактымды ыйлап өткөрөм, азаптын басылышын каалайм ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.04204171150922775, -0.022934677079319954, ...</td>\n","      <td>Менин акыркы ажырашуумдан улам депрессияга каб...</td>\n","      <td>0.999795</td>\n","      <td>negative</td>\n","      <td>[Менин акыркы ажырашуумдан улам депрессияга ка...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [Менин акыркы ажырашуумдан улам депрессияга ка...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":44}]},{"cell_type":"markdown","metadata":{"id":"DGMVMKaTdJFj"},"source":["# The Model understands Tamil\n","![ta](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"JWDr_LoCdJFn","executionInfo":{"status":"ok","timestamp":1620202645336,"user_tz":-300,"elapsed":699734,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"b75e1667-223b-4d7a-d22e-85e556c26af7"},"source":["# Tamil for: 'I am depressed because of my recent break up and I spend all my time crying, I want the pain to go away...'\n","fitted_pipe.predict(\"நான் சமீபத்தில் பிரிந்ததால் மனச்சோர்வடைந்து, என் நேரத்தை அழுதபடி செலவிடுகிறேன், வலி நீங்க வேண்டும் என்று நான் விரும்புகிறேன் ... \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.02321743592619896, -0.03598147630691528, 0...</td>\n","      <td>நான் சமீபத்தில் பிரிந்ததால் மனச்சோர்வடைந்து, எ...</td>\n","      <td>0.999127</td>\n","      <td>negative</td>\n","      <td>[நான் சமீபத்தில் பிரிந்ததால் மனச்சோர்வடைந்து, ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [நான் சமீபத்தில் பிரிந்ததால் மனச்சோர்வடைந்து, ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":45}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"Q6C0BmTtdJFp","executionInfo":{"status":"ok","timestamp":1620202646105,"user_tz":-300,"elapsed":700498,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"b9d5e5d9-454b-4e7a-b9ed-aa007d153ab8"},"source":["# Tamil for : 'The love of my life proposed me , I feel like the happiest person alive!'\n","fitted_pipe.predict(\"என் வாழ்க்கையின் அன்பு என்னை முன்மொழிந்தது, உயிருடன் இருக்கும் மகிழ்ச்சியான நபராக நான் உணர்கிறேன்! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>origin_index</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>[-0.0001591779146110639, -0.012185914441943169...</td>\n","      <td>என் வாழ்க்கையின் அன்பு என்னை முன்மொழிந்தது, உய...</td>\n","      <td>0.999979</td>\n","      <td>positive</td>\n","      <td>[என் வாழ்க்கையின் அன்பு என்னை முன்மொழிந்தது, உ...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["   origin_index  ...                                           sentence\n","0             0  ...  [என் வாழ்க்கையின் அன்பு என்னை முன்மொழிந்தது, உ...\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":46}]},{"cell_type":"markdown","metadata":{"id":"2BB-NwZUoHSe"},"source":["# 5. Lets save the model"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"eLex095goHwm","executionInfo":{"status":"ok","timestamp":1620203401449,"user_tz":-300,"elapsed":1455834,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"1c18be45-35a1-44fa-fe92-6f33966a145f"},"source":["stored_model_path = './models/classifier_dl_trained' \n","fitted_pipe.save(stored_model_path)"],"execution_count":null,"outputs":[{"output_type":"stream","text":["Stored model in ./models/classifier_dl_trained\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"e_b2DPd4rCiU"},"source":["# 6. Lets load the model from HDD.\n","This makes Offlien NLU usage possible!   \n","You need to call nlu.load(path=path_to_the_pipe) to load a model/pipeline from disk."]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"SO4uz45MoRgp","executionInfo":{"status":"ok","timestamp":1620203683025,"user_tz":-300,"elapsed":128872,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"c90432d6-9183-49c2-865a-8dd53bf11584"},"source":["import nlu\n","stored_model_path = './models/classifier_dl_trained' \n","hdd_pipe = nlu.load(path=stored_model_path)\n","preds = hdd_pipe.predict('It was one of the best films i have ever watched in my entire life !!')\n","preds"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>text</th>\n","      <th>sentence</th>\n","      <th>sentiment</th>\n","      <th>document</th>\n","      <th>origin_index</th>\n","      <th>sentiment_confidence</th>\n","      <th>sentence_embedding_from_disk</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>It was one of the best films i have ever watch...</td>\n","      <td>[It was one of the best films i have ever watc...</td>\n","      <td>[positive, positive]</td>\n","      <td>It was one of the best films i have ever watch...</td>\n","      <td>8589934592</td>\n","      <td>[0.9999969, 0.9999969]</td>\n","      <td>[[0.016216373071074486, 0.02273012138903141, -...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                                text  ...                       sentence_embedding_from_disk\n","0  It was one of the best films i have ever watch...  ...  [[0.016216373071074486, 0.02273012138903141, -...\n","\n","[1 rows x 7 columns]"]},"metadata":{"tags":[]},"execution_count":1}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"UqXHHH-TQTuu","executionInfo":{"status":"ok","timestamp":1620204016789,"user_tz":-300,"elapsed":959,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"c45e062e-ff9e-4fb4-9bc2-53356dbeec89"},"source":["hdd_pipe.print_info()"],"execution_count":null,"outputs":[{"output_type":"stream","text":["The following parameters are configurable for this NLU pipeline (You can copy paste the examples) :\n",">>> pipe['document_assembler'] has settable params:\n","pipe['document_assembler'].setCleanupMode('shrink')              | Info: possible values: disabled, inplace, inplace_full, shrink, shrink_full, each, each_full, delete_full | Currently set to : shrink\n",">>> pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'] has settable params:\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setExplodeSentences(False)  | Info: whether to explode each sentence into a different row, for better parallelization. Defaults to false. | Currently set to : False\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setStorageRef('SentenceDetectorDLModel_c83c27f46b97')  | Info: storage unique identifier | Currently set to : SentenceDetectorDLModel_c83c27f46b97\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setEncoder(com.johnsnowlabs.nlp.annotators.sentence_detector_dl.SentenceDetectorDLEncoder@1dde65a2)  | Info: Data encoder | Currently set to : com.johnsnowlabs.nlp.annotators.sentence_detector_dl.SentenceDetectorDLEncoder@1dde65a2\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setImpossiblePenultimates(['Bros', 'No', 'al', 'vs', 'etc', 'Fig', 'Dr', 'Prof', 'PhD', 'MD', 'Co', 'Corp', 'Inc', 'bros', 'VS', 'Vs', 'ETC', 'fig', 'dr', 'prof', 'PHD', 'phd', 'md', 'co', 'corp', 'inc', 'Jan', 'Feb', 'Mar', 'Apr', 'Jul', 'Aug', 'Sep', 'Sept', 'Oct', 'Nov', 'Dec', 'St', 'st', 'AM', 'PM', 'am', 'pm', 'e.g', 'f.e', 'i.e'])  | Info: Impossible penultimates | Currently set to : ['Bros', 'No', 'al', 'vs', 'etc', 'Fig', 'Dr', 'Prof', 'PhD', 'MD', 'Co', 'Corp', 'Inc', 'bros', 'VS', 'Vs', 'ETC', 'fig', 'dr', 'prof', 'PHD', 'phd', 'md', 'co', 'corp', 'inc', 'Jan', 'Feb', 'Mar', 'Apr', 'Jul', 'Aug', 'Sep', 'Sept', 'Oct', 'Nov', 'Dec', 'St', 'st', 'AM', 'PM', 'am', 'pm', 'e.g', 'f.e', 'i.e']\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setModelArchitecture('cnn')  | Info: Model architecture (CNN) | Currently set to : cnn\n",">>> pipe['bert_sentence@labse'] has settable params:\n","pipe['bert_sentence@labse'].setBatchSize(8)                      | Info: Size of every batch | Currently set to : 8\n","pipe['bert_sentence@labse'].setCaseSensitive(False)              | Info: whether to ignore case in tokens for embeddings matching | Currently set to : False\n","pipe['bert_sentence@labse'].setDimension(768)                    | Info: Number of embedding dimensions | Currently set to : 768\n","pipe['bert_sentence@labse'].setMaxSentenceLength(128)            | Info: Max sentence length to process | Currently set to : 128\n","pipe['bert_sentence@labse'].setIsLong(False)                     | Info: Use Long type instead of Int type for inputs buffer - Some Bert models require Long instead of Int. | Currently set to : False\n","pipe['bert_sentence@labse'].setStorageRef('labse')               | Info: unique reference name for identification | Currently set to : labse\n",">>> pipe['sentiment_dl@labse'] has settable params:\n","pipe['sentiment_dl@labse'].setThreshold(0.6)                     | Info: The minimum threshold for the final result otheriwse it will be neutral | Currently set to : 0.6\n","pipe['sentiment_dl@labse'].setThresholdLabel('neutral')          | Info: In case the score is less than threshold, what should be the label. Default is neutral. | Currently set to : neutral\n","pipe['sentiment_dl@labse'].setClasses(['positive', 'negative'])  | Info: get the tags used to trained this SentimentDLModel | Currently set to : ['positive', 'negative']\n","pipe['sentiment_dl@labse'].setStorageRef('labse')                | Info: unique reference name for identification | Currently set to : labse\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"xdgt0jiIr1A2"},"source":[""],"execution_count":null,"outputs":[]}]}